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Abstract 

We study an interacting particle system whose dynamics depends on 
an interacting random environment. As the number of particles grows 
large, the transition rate of the particles slows down (perhaps because 
they share a common resource of fixed capacity). The transition rate 
of a particle is determined by its state, by the empirical distribution of 
all the particles and by a rapidly varying environment. The transitions 
of the environment are determined by the empirical distribution of the 
particles. We prove the propagation of chaos on the path space of 
the particles and establish that the limiting trajectory of the empirical 
measure of the states of the particles satisfies a deterministic differential 
equation. This deterministic differential equation involves the time 
averages of the environment process. 

We apply the results on particle systems to understand the behav- 
ior of computer networks where users access a shared resource using 
some distributed random Medium Access Control (MAC) algorithms. 
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These algorithms are used in all Local Area Network (LAN) , and have 
been notoriously difficult to analyze. Our analysis allows us to pro- 
vide, for the first time, simple and explicit expressions of the network 
performance under such algorithms. 

AMS classification : primary 60K35 ; secondary 60K37,90B18. 
Keyword : Mean field analysis ; Particle system. 

1 Introduction and motivation 

The paper comprises two separate parts: a first part is devoted to the anal- 
ysis of the mean field limits of a general system of interacting particles, also 
interacting with a random environment. In the second part of the paper, 
we demonstrate how the results on particle systems derived in the first part 
can be applied to understand the behavior of computer networks where users 
access a shared resource using some distributed random Medium Access Con- 
trol (MAC) algorithms. These algorithms are implemented in the network 
access card of all computers connected to a Local Area Network (LAN). 
LANs are networks covering a small geographic area, like a home, an office, 
a building, and constitute a first and crucial component of the Internet. An- 
alyzing random MAC algorithms is notoriously difficult; most of the related 
issues have actually been open since the introduction of the first of these 
algorithms in the early 70's. In [7], the author has used heuristic formulas 
to approximate their performance in specific networks. These formulas are 
based on the assumption that the particles (or computers) evolve indepen- 
dently. Our mean field analysis rigorously proves this propagation of chaos, 
but also allows for the first time to derive explicit analytical expressions of 
the performance of these algorithms in general networks. 
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A particle system interacting with a random environment In the 

first part of the paper, we are interested in the mean field limit of a system 
of N interacting particles whose dynamics also depends on an environment 
process. More specifically, the evolution of each particle depends on the 
state of the particle, on the empirical distribution of all the particles and also 
on environment variables. The environment process is a finite state space 
Markov chain which interacts with the particle system because its transition 
kernel depends on the empirical distribution of the states of the particles. A 
key feature of the systems considered here is that the environment is rapidly 
varying: it evolves at rate 1, whereas the particles evolve at rate 

We prove a mean field limit for this particle system when N goes to 
infinity. In order to capture the evolution of the particles we must speed 
up time by a factor of N. In so doing the particles see a time average of 
the rapidly changing environment. In the mean field limit, particles evolve 
independently, and see the environment process in its steady state, which in 
turn evolves as the particles evolve. 

Our results on a particle system evolving in a rapidly changing environ- 
ment is a generalization of results obtained by Kurtz in [23] . We extend these 
results in a couple of ways: first, the particles may evolve according to their 
current states, to the empirical distribution of the states of the particles, 
and to an environment process; then we show the path-space convergence 
of the trajectory of the empirical distribution of the states of the particles. 
To prove this convergence, we extend and adapt the method developed by 
Sznitman and Graham in [271 [T8] . 

The initial motivation for the use of mean field asymptotics was to ana- 
lyze the behavior of computer networks. Of course, mean field models have 
been used in many contexts and the theory is well developed. For example, 
Dawson [12] studies a model in statistical physics where N particles diffusing 
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in a potential well have the additional property that they are all attracted 
to the center of mass of all the particules. The Fleming- Viot model [13] is 
an example from genetics where a particle represents an individual and its 
state represents the genetic type and its location. Our results (and those 
in [23]) on interacting particle systems with a rapidly varying environment 
could find other applications. For instance, they could be used to capture 
the dynamics of a population whose genetic makeup evolves slowly in time 
in the presence of a rapidly varying environment whose evolution may partly 
depend on the empirical distribution of the individuals. Another potential 
field of application is microscopic models in economic theory and stochastic 
market evolution, also known as " econophysics" , see for example the work by 
Karatzas [_20j or Cordier [llj. In a simple market economy or in a financial 
market, a particle is an economic agent and its states represents its goods 
and its savings. The environment is the prices of the various available goods. 
Agents may exchange, borrow or lend money. Both prices and the purchase 
decisions of agents are interacting. In some markets, like financial markets, 
the prices are fluctuating roughly N times faster than the decisions of each 
individual agent. 

Analyzing Medium Access Control algorithms in computer net- 
works Consider N users (or computers) communicating in a wired or wire- 
less Local Area Network (LAN). To transmit data packets, users have to 
share a single resource (a cable in wired LANs or a radio channel in wireless 
LANs) using some Medium Access Control (MAC) protocols. These proto- 
cols are distributed, meaning that each user runs its protocol independently 
of the other users sharing the same resource. This architecture has ensured 
the scalability of LANs (in the sense that new users can join and leave the 
network without the need of explicitly advertising it); it has played a crucial 
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role in their development and hence contributed to the rapid growth of the 
Internet. 

When two users cannot simultaneously successfully transmit data packets 
(because they share the same resource), we say that these users interfere. 
Two interfering users who simultaneously transmit experience a collision, 
and the packets have to be retransmitted. Most current MAC protocols 
limit collisions using the following two main principles: first, before trans- 
mitting, users sense the resource and should it be busy they abstain from 
transmitting. This technique is referred to as CSMA (Carrier Sense Multiple 
Access) and ensures that packet transmissions cannot be interrupted. Even 
if the sensing mechanism is perfect, a collision may still occur if two inter- 
fering users start transmitting at the same time (or rather so close together 
in time that CSMA can't prevent the collision). The second main principle, 
termed random back-off, aims at reducing the possibilities that several users 
start transmitting simultaneously. To do so, a user only starts transmit- 
ting with a certain probability less than one. This probability is adapted to 
the number of successive collisions experienced by users, which allows users 
to infer the level of congestion of the resource. Typically, in LANs today, 
users implement the exponential back-off algorithm (also referred to as the 
Decentralized Coordination Function (DCF) in the standards, see j7j and 
references therein for a detailed description of these standards): the trans- 
mission probability is divided by a factor two after each collision, and it is 
reinitialized after the successful transmission of a packet. 

The performance of MAC protocols is measured in terms of the through- 
put realized by the various users, i.e., of the number of packets successfully 
transmitted by users per second. The performance analysis requires that we 
can characterize the joint evolution of the transmission probabilities of the 
N users (see Section [5] for the state of the art). These probabilities evolve 
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according to a A^-dimensional Markov chain that is usuahy intractable be- 
cause of the correlations introduced by collisions. Mean field asymptotics 
are useful to approximate this evolution. 

In this paper, we consider two relevant scenarios for interference. We 
consider networks with full interference where all pairs of users interfere, 
and networks with partial interference where users do not interfere with all 
other users. In the latter scenario, users are classified according to the set 
of users they interfere with. Partial interference typically arises in wireless 
networks as illustrated in Figure [TJ all 6 users are willing to transmit data 
packets to the access points 1 or 2; class-1 (resp. class-3) users interfere 
with users of classes 1 and 2 (resp. 2 and 3), whereas class-2 users interfere 
with all users. Two users of class 1 and 3 respectively can not sense each 
other and this can lead to fairness issues: users of class 2 find themselves 
in a predicament like that of a polite nephew sitting on a sofa between two 
garrulous aunts who are hard of hearing and therefore hear the nephew but 
not each other. Each aunt will launch into a new dialogue before the other 
aunt has finished. The poor nephew will hardly ever get a word in! 




class-1 users class-2 users class-3 users 

Figure 1: A network with partial interference - A dashed line between two 
users means that they sense each other. 

In Section [5l we apply the results derived for the particle systems to pro- 
vide accurate approximations of the performance of a general class of MAC 
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protocols in networks with full or partial interference. A user is modeled 
as a particle whose state includes its transmission probability and its class 
in the case of partial interference. The particles interact with each other 
because of collisions. If the access protocol is fair each user will necessarily 
share around of the resource; i.e. the transmission probability of users 
slows down as N increases. Our mean field limit will therefore depend on 
rescaling and speeding up time by a factor of N. The environment process 
captures the fact that for a given user, the resource is sensed busy or idle. 
For example, the environment of the network in Figure [1] is represented by 
a vector z = (zi, 225^3) of zeros and ones. The environment (1,0,1) would 
represent ongoing transmissions from a user in class 1 and a user in class 3. 
When a user transmits the resource is blocked; i.e. the environment changes. 
These environmental changes occur at rate determined by N users; i.e. at 
rate 1. Consequently the conditions for our theory are met. 

Notations Let S be a separable, complete metric space, V{S) denotes 
the space of probability measures on y. C{X) is the law of the S'-valued 
random variable X. D{M'^,S) the space of right-continuous functions with 
left-handed limits, with the Skorohod topology associated with its usual met- 
ric, see [l5] p 117. With this metric, D(R'^,S) is complete and separable. 
We extend a discrete time trajectory {X{k)),k G N, in D(N, 5) in a con- 
tinuous time trajectory in D(M+,5') by setting for t G M+, X(t) = X([t]), 
where [•] denotes the integer part. {J-t),t G or N, will denote the nat- 
ural filtration with respect to the processes considered. || • || denotes the 
norm in total variation of measures. Finally, for any measure Q G V{S) and 
any measurable function / on y, {f,Q) = Qif) = j fdQ denotes the usual 
duality brackets. 

We recall that a sequence of random variables (^/^)iG{i,...,Ar} G 5^ is 
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exchangeable if mXf)ie{i,...,N}) = mX^^))ie{i,...,N}) where a is any per- 
mutation of {1, ... , N}. Moreover the sequence is Q-chaotic if for all subsets 
/ C N of finite cardinal |/|, 

lim £ ((Xf = weakly in ViS^'^). (1) 

AT— >oo 

2 An interacting particle system in a varying en- 
vironment 

In this section, we first provide a precise description of the interacting par- 
ticle system under consideration. We then state the main results, giving the 
system behavior in the mean field limit when the number of particles grows 
to infinity. The proofs of these results are postponed to subsequent sections. 

2.1 Model description 

The particles We consider N particles evolving in a countable state space 
X at discrete time slots fc G N. For simplicity we assume the particles are 
exchangeable. At time k, the state of the i-th. particle is Xf{k) G X. 
The state of the system at time k is described by the empirical measure 
v^{k) G V{X) while the entire history of the process is described by the 
empirical measure on path space V{D{H, X)): 

1 ^ 1 ^ 

^^~^ = nY. ^x^{k) and = j;^Yl '^^f • 

i=i 1=1 

The interacting environment In the system considered, the evolution 
of the particles depends not only on the state of the particle system but 
also on a background Markovian process = {Z^ , • • • , Z^) G D{N, Z^), 
where Z is a countable state space. Specifically, Z^ is a Markov chain whose 
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transition kernel satisfies the following: 

P(Zi^(/c + l) = z|^fe) =i^f^(,)^^^^(,)(Zf (2) 

where Kj^,^ is a transition kernel on Z depending on a probability measure ^ 
onV{X) and on X € X, and where J^fc = a ((z^^(O), Z^(0)), • • • , {i^^ (k), (k))) . 
The latter filtration depends on N, but as pointed out above, without possi- 
ble confusion, J^^ will always denote the underlying natural filtration of the 
processes. Note that ^ does not completly defined the transition kernel 
of , and actually the joint evolution of the vector {Z^{k), ■ ■ ■ , Z^{k)) is 
arbitrary. 

Evolution of the particles We represent the possible transitions for a 
particle by a countable set S of mappings from X to X. A s-transition for a 
particle in state x leads this particle to the state s{x). We assume that the 
conditional probability given that a s-transition occurs for the particle i 
between times k and A; -|- 1 is equal to 

^F^{X^{k),u''{klZ^{k)). (3) 

with a,z) = I for all (x, a, z) £ XxV{X) xZ (the assumption is 

for simplicity, the content of the paper is unchanged if Ylses ^s^i^^ a,z) < C 
for some constant C independent of {x,a,z)). 
We define the events 

Af^ (k) = {a transition occurs for particle i between times k and k + 1}. 

We assume that the joint distribution of the transitions is weakly correlated. 
More precisely. 
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AO. There exists a positive sequence {pN)NeN such that hrriTv pn = and 



P{A^{k)A^{k)\:F,)<!^. (4) 

Note that, due to 1^, the process evolves quickly while the empir- 
ical measure {k) evolves slowly. Also note that the s-transitions of the 
various particles may be correlated. The process may depend on the 
transitions of the particles. The particle system is thus in interaction with 
its environment. Note finally that if the particle transitions are independent 
then (HD holds with pj^ = l/N. 

We make the following additional assumptions on the system evolution. 

Assumptions 

Al. Uniform convergence of to Fs'. 

limTv^oo ^^V(x,a,z)eXxV(X)xZ T.ses l^^i^^ ^) - ^six, a,z)\= 0. 

A2. The functions -Fs is uniformly Lipschitz: 

sup(^,^)eA'x2Ese5 - F'six,f3,z)\ < C\\a- 

A3. Uniform convergence in total variation of to Ka- 

limAr_^oo SUP(^_Q^^)g^x-p(A')x2 \\I^a,xi^^') - Ka,x{z,-)\\ = 0. 

A4. The mapping a is uniformly Lipschitz: 

s^Pix,z)&XxZ \\Ka,xiz^ •) - Kf3,xiz, ■)\\ < C\\a - 

A5. The Markov chains with kernels K^^x have a unique stationary proba- 
bility measure 7ra,x- 

A6. For all x in ^, a, /? in V{X): WiTa^x — '^i3,x\\ < C sup^g^ \\Ka,xiz, •) — 

Kf3,x{z, ■)\\. 

We discuss in Section U] how the above assumptions may be checked. 
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2.2 Main Results 

The main result of this paper is to provide a mean field analysis of the system 
described above, i.e, to characterize the evolution of the system when the 
number of particles grows. According to ([3]), as ^ cxo, the chains Xf{t) 
slow down hence to derive a limiting behavior we define: 

1 ^ 

qf{t)=Xf{[m]) and = -Y^8^m e V{D{^+, X)). 

i=l 

We wish to apply the ideas in Theorem 2.1 in [53]. In that context we 
define the joint measure 

1 ^ 

C^(fc)(^ ^B) = -Y. x{Xf{k) G A, Zf{k) G B} 

i=l 

for A C X and B Q Z. Clearly the evolution of is determined by . 
Next we rescale time and define Y'^{t){A x B) = (^^[[Nt]). In the context 
of [23] our is Kurtz's X]\f and our is Kurtz's Yjy. However we can't 
quite apply the theorems in [23] because the transition kernel of Zj^ depends 
on both and . 

Following [23] we define £m {2^ x X) to be the space of measures on [0, oo) x 
Z X X such that for 7 G £m{2^ x X), 7([0, t] x Z x X) = t. Define 

T^{[0,t] xAxB)= ['y^{s){A X B)ds. 
Jo 

Note that {[0,T], x, Z) = ^^{s){x)ds. Since Y^ doesn't slow down as 
N —>■ 00 like /i^ we can't hope to prove the weak convergence of 1"^ but the 
occupation measure T^ does converge weakly by averaging. To obtain the 
relative compactness of T^ and fi^ we require the following assumptions. 

A7. For each e > and each t > there exists a compact IC Q X x Z such 
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that limmfjv-E[r^([0,t] x K)] > (1 - e)t. 
A8. C{q^{-)) is tight in V{D{W+,X)). 

In most apphcations, the tightness of C{q^ {■)) in V{D{W^ , X)) is not a 
major issue. Indeed, note that the inter-arrival times between two transitions 
of qi {■) are independent Binomial (A^, variables (which converges to 
exponential (1) variables). Hence, if for example the state space X or the 
set of transitions S is finite, we may apply the tightness criterion Theorem 
7.2 in Ethier-Kurtz [T5] p. 128. 

2.2.1 Transient regimes 

The following theorem provides the limiting behavior of the system in tran- 
sient regimes. 

Theorem 2.1 Assume that the Assumptions A0-A8 hold and that the initial 
values qf{0), i = 1,. . . ,N, are exchangeable and such that their empirical 
measure fiQ converges in distribution to a deterministic limit Qq € 'P{X) 
when N — > oo. There exists a probability measure Q on D(M+, Af) such that 
the processes {qf {.), i G {1, . . . , N}) are Q-chaotic. 

In [27], Sznitman proved that if q^{0), i = 1, . . . ,N, are exchangeable, 
their empirical measure fiQ converges in distribution to a deterministic limit 
Qo G V{X) if and only if q^{0), i = I,... ,N, are Qo-chaotic. Then, the 
above theorem states that if the particles are initially asymptotically inde- 
pendent, then they remain asymptotically independent. This phenomenon 
is also known as the propagation of chaos. 

The independence allows us to derive an explicit expression for the sys- 
tem state evolution. As explained earlier, intuitively, when is large, the 
evolution of the background process is very fast compared to that of the 
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particle system. The particles then see a time average of the background 
process. The following theorem formalizes this observation. For a S ^{X) 
and X ^ X, let tTq .j. denote the stationary distribution of the Markov chain 
with transition kernel K^^x- We define the average transition rates for a 
particle in state x by 

Fs{x,a) = '^Fs{x,a, z)iTa,x (z) . (5) 

Define = Q{t)i{xn}) where X = {x„,n G N}. is the limiting 

(when — s- oo) proportion of particles in state x„ at time t. 

Theorem 2.2 Under the assumptions of Theorem \2.1\ the limiting propor- 
tions Q^{t) of the particles in the various states satisfy: (5"(0) = Qo{{xn}) 
and for all time t > 0, for all n G N, 

sG<S m:s(xm)=Xn sG<S 

The equations ([6]) have the following interpretation: if s{xm) = a^n then 
Q'^{t)F s{xm,Q{t)) is a mean flow of particles from state Xm to Xn- Hence, 
I]se5 X]m:s(a;„)=a;„ ^""(^-^8(2:;™, Q(i)), is the total mean incoming flow of 
particle to x„ and Y^sesQ'^^^)^ s{xn-,Q{t)) is the mean outgoing flow from 

Xn- 

2.3 Stationary regime 

We now characterize the stationary behavior of the system in the mean field 
limit. To do so, we make two additional assumptions: 

A9. For all A^, the Markov chain {{Xj^ {k))i<,i<]\[, {k))k^f^ is positive 
recurrent. The set of stationary distributions £sf(Xf') is tight. 
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AlO. The dynamical system ([6]) is globally stable: there exists a measure 
= iQ2t) e 'Pi'^) satisfying for all n: 

J2 E Q^Fs{x^,Qst)=QlY.^siXn,Qst), (7) 

and such that for all Q G 'P(D(M+, X)) satisfying Q, for all n, lim^^+oo 

Then the asymptotic independence of the particles also holds in the station- 
ary regime: 

Theorem 2.3 Under Assumptions AO- AlO, for all subsets I C N of finite 
cardinal \I\, 

hm {{qf{.))i^l) = QT weakly m P(Z)(M+, 

3 Proof of Theorems EOl 122] and [23] 

We use the following notation extensively: 

A^'^{k) = {s-transition occurs for the particle i between k and k + 1}. 

(8) 

By definition, we have: 



We also recall the notation 

Af{k) = {a transition occurs for particle i between times k and k + 1}. 

(9) 

We have: Af{k) = UsesA^''ik). 
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3.1 Proof of Theorems [HI] and [272] 

By Proposition 2.2. in Sznitman [27], Theorem 12.11 is equivalent to 

lim C{fi^)=5Q weakly in P(P(D(M+,;f))). (10) 

N^oo 

To establish (jlOp . we first prove the tightness of the sequence C{^^ ,r^). 
We then show that any accumulation point of the previous sequence is the 
unique solution of a martingale problem. This requires idea from Theorem 
2.1 and Example 2.3 in [23]. 

3.1.1 Step 1 : Relative Compactness 

First we check that the sequence C{fi^) is tight in 'P{V{D{R.'^ , <Y))). Thanks 
again to Sznitman [27] Proposition 2.2, this a consequence of the tightness 
of £{q^{.)) in 'P{D{R+,X)); i.e. of A8. By Prohorov's theorem C{n^) is 
relatively compact. By Lemma 1.3 in [23j, P^ is relatively compact because 
of the compact containment hypothesis A7. It follows that the sequence 
£(/i^,r^)) is relatively compact. 

3.1.2 Step 2 : Convergence to the solution of a martingale prob- 
lem 

We will follow the Step 2 in Graham [18]. We show that any accumulation 
point of C{fi^ ,r^) satisfies a certain martingale problem. For / E L°°(Af), 
the bounded and forcibly measurable functions of A" — > M. For each s S 5, 
we define 

r(x) = /(s(x))-/(x). 
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Now, for / G T > 0, and t < T, 

[TVT] — 1 

= E E n^fii^)){x{A^''m-p{Af'\k)\:F,)) 

ses k=[Nt] 

INT]-1 

+E E r(^f(|))p(A'''^(^)i-^fc)- (11) 

sG5 fc=[Aft] 

Then we define M/'^(t) = Esg5 ^^/'^''(^ ^i^h 

[Aft]-1 

m/'^'^w= E n<i^i^)){x{A^''m-PiA^^\k)\:F,)) (12) 

fe=0 

and 

So that, we may rewrite Equation (llip as 

[AfT]-l 

- /(gf(t)) = M/'^(T)-M/'^(t) + ^ 5; E^f'^/(^) 

fc=[Art] se5 

= M/'^(r) -M/'^(t) 

+ r j;r(<zf(n))Ff (gf(n),/i^(n),Zf H)dn. (13) 

The proof of the following lemma is given at the end of this section. 

Lemma 3.1 M-'^{t) defined at is a square-integrable martingale. There 
exists C > such that the Doob-Meyer brackets {uf'^ ,Mf'^)t < Ct||/||^ 
andfori^j, | (m/'^, m/'^)^ | < Ct||/||^ max(p;v, l/A^)- 

Now assume that Lemma [3 . 1 1 holds . and let 11°° be an accumulation point 
of i3(/i^, r^). Let (/i, r) be a random variable taking values in 'P(D(M+, ^)) X 
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Imi2^ X ^) having distribution n°° which is adapted to a complete filtration 
J^t in the sense that for each t, T{[0,t], x, z) is ^t-measurable. By continu- 
ity T{[0,t\,x, Z) = f^fi^{s)ds, where //^(s) = /u(s)({x}). By Lemma 1.4 
in [23] there exists an .T^t-predictable V{X, Z) valued process 7 such that 
n°°-almost surely, 

r{[0,t],x,z) = ju{x,z)du. 
Jo 

Define the Radon-Nikodym derivative: 



, , T{dt,x,z) T{dt,x,z) 



T{dt,x,Z) n''{t)dt 
Clearly 'y(t,x,r)iz) = jt{x, z)/jtix, Z) n°°-almost surely. 
Lemma 3.2 We have: 

Proof. Define (x, z) = J2ti x{X^ (k) = x, Zf {k) = z}, we have 

, m 

r^([o,t],x,z) = -j;r^(x,z) 

A;=0 
fc=0 

[Nt]-1 

+N E(rf+i(^'^) • (14) 

fc=0 

The first term in the above expression goes to as goes to infinity. The 
third term is a mean zero martingale. From Dynkin formula, we have 



N 

k=0 



, [Nt]-l 

^ E {T^^,{x,z) - E{T^_,,{x,z)\J^,))' < -. 

k=0 
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The second term in (jl4p is equal to 

[7Vt]-l 
k=0 

. N [Nt]-1 

= nT.n H E{x{Xt^{k + l)=x,Z,'^ik + l) = z}\J^,) 

i=l k=0 

. N [Nt]-1 

i=l k=0 y 

i=l k=Ow.s{w)=x 

Note that from ^ 

xlX^'ik) = w}P{A^'\k), Zfik + 1) = < P {Af{k)\T,) < 1. 

w:s{w)=x 

Thus, as — > cx) the only important term in psp is the first sum and it is 
equivalent to: 

. N 

nT^nE T.^{Xrik)=x,Zt'{k)=y}K^^^,^Jy,z) 
i=l k=0 y 

= ^E^ E ExUfq) = -,Z-ik) = y}K-^^^^Jy,z) 

i=l k=0 y 




as N ^ Qo (by Assumptions A3-A4). Therefore, our calculation gives, 
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It follows that r([0, t],x, z) = Jq Ylyez ^{du, x, y)K^(u),x{yi z)du almost surely 
and hence that ^t{x-,z) = J2ijeZ^i(^^y)^fj-{t),x{yT z) almost everywhere in t 
n°°-almost surely. However for a given fi(t) and x, by Assumption A5 there 
is a unique solution to the above which is a probability; i.e. for all z & Z, 

lt{x, z)/jt{x, Z) = T^^i^t)A^)- ° 

Lemma 3.3 // satisfies a non-linear martingale problem starting at Qq. 
Specifically, for all f € L'^{X), 

Mf{T) = f{X{T)) - fiXm - r Qf{X{u),i,{u))du (16) 

JO 

is a jjL-martingale, where X = {X{t))t>Q denotes a canonical trajectory in 
D{M+,X), ^(0) = Qo, n~-a.s. and 

gf{x,f,{t)) = J2n^Wsix,Kt))- 

s 

Proof. The proof is similar to Step 2 of Theorem 3.4 of Graham [T8] or of 
Theorem 4.5 of Graham and Meleard [17j. However, here our assumptions 
are weaker so we detail the proof. 

From Lemma 7.1 in Ethier and Kurtz [15], the projection map X X{t) 
is fi-a.s. continuous for all t except perhaps in at most a countable subset 

of M+. Further it is shown easily that D = {t e R+ : U'^H^i : t e 
D^}) > 0} is at most countable (see the argument in the proof of Theorem 
4.5 of Graham and Meleard [f7]). 

Take < ti < t2 < ■ ■ ■ tj, < t < T outside D and g £ L°°{X''). Take 
/ G L~(Af). The map G : V{D(R+, X)) M defined by 

R ^ { (^/(X(T)) - /(X(t)) - gfiXiu),^it))dv}j giXiti), Xitk)), R) 
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is n°°-a.s. continuous. We will prove that 



n°°-a.s, G{fi) = 0. 



(17) 



Now assume (jl7p holds for arbitrary < ti < t2 < ■ ■ ■ ^fc < t < T out- 
side a countable set D and g € Ct(<Y'^). It implies that for all A C J-t, 
(M^(r)lA,/i) = (M^(t)lA,/i). Therefore, by definition, M^(t) is a ;U- 
martingale and /i satisfies the non- linear martingale problem (jl6p . 

It remains to prove (fT7|) . Let 11''^ be the law of (/x^,r^), we write : 



i=l 

N 



1 



N 



N N . T 

i=l i=l ^•'^ 



where gf = g{qf{ti), . . . , (tfc)). From (US}, 



AT/ 



se5 



e/(gf(n),/i(^z))dn)5f . 



Hence, 



E|(G,n^)| < E 



+E 



l5^(AfP(r)-MP(0W 

i=l 



< I + 11, 
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Using exchangeability and the Cauchy-Schwartz inequahty, we obtain: 



j2 < M^E(M/'^(T)-M/'^(t)'' 



( {Mr (T) - Mr {M^ (T) - M^ {tM 



Lemma |3 . 1 1 imphes that I tends to 0. 
Next, 11^ is less than or equal to 



i=l 



s€S 

T , X 2 

^/(gf(n),/x^(tx))dn 



< IbllLE / j;5]r(x)Ff(x,/.^(n),z)r^(dn,x,z) 
Y,Gf{x,^i''{u))T''{du,x,Z) \ . 

^ X J 

However, as ^ oo, 

z 

Y Yj f''i^)^s{x, z)T{du, X, z), 



sg5 x,z 



sg5 x,z 



and using Lemma [ 

5^(?/(x,/i^(n))r^(dn,x,Z) 

X 

-- fYY. fi^)^s{x, /x^H, z)7(i,,,r)(z)r^(dn, x, Z) 

•^^ S X 

rT 

-> / YYf'{x)F,{x,n{u),z)-f,^t,x,r)iz)T{du,x,Z) 

s x,z 

rT 

= J 'Y'Yf{x)Fs{x,^j.{u),z)r{du,x,z). 



ses x,z 
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Consequently 11^ — > as — > oo. 

Hence, from ([IHD and Fatou's Lemma, (|G|,n~) < limAr(|G|, H^) = 
and thus n°°-a.s, G{fi) = 0, (fT7|) is proved. 

To conclude the proof of Lemma 13.31 note that the continuity of X — 
X(0) implies fi{0) = Qo, n°°-a.s.. □ 

3.1.3 Step 3 : Uniqueness of the solution of martingale problem 



We now show the solution to (jl6p is unique. Here, we will use Proposi- 
tion 2.3 in Graham [18] (which is an extension of Lemma 2.3 in Shiga and 
Tanaka [26]) to show uniqueness. We remark that Gf{x,a) = j\^ifiy) — 
f{x))Jx,a{dy) where 

ses 

Next, II Ja;,a|| = J2ses = 1 ^'^'i \\Jx,a-Jx,f3\\ = ^up \ J;^ ipiy)Jx,aidy)- 

Jx v{y)Jx,i3{dy)\ where the supremum is over the functions ip E L°°{X) with 

IIV^Iloo < 1- 



\JxA'f) - Jx,p{'f)\ =1 ^v'(s(x)) Fs{x,a) - Fs{x,P) 

ses 

= \^'^v{s{x)) Fs{x,a,z)TTa,x{dz) - Fs{x,l3,z)TTf3^x{dz) 

ses ■^^ ■^^ 

- I'^'^i^i^)) [ Fs{x,a,z)TTa,x{dz) - Fs{x,a,z)7rp^^{dz) 
ses ^ 

+ I / Fs{x,a,z)TTf}^^{dz) - / Fs{x, [3, z)TTf3^^{dz 



seS 
< I + H. 
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By Fubini's Theorem, 



I 



'^(p{s{x))Fs{x,a,z)Tra,xidz) - / '^Lp{s{x))Fs{x,a,z)TTi3^xidz 



< \\^ ip{s{x))Fs{x, a, ■)\\oo\\T^a,x - '^I3,x\\- 



Since \ip{s{x))\ < 1, Fs{x,a,z) > and ^^^s ^six,a, z) = 1, 

II J^V9(s(x))F,(x,a,-)||oo < 1. 
Thus applying Assumptions A4-A6, we deduce: 

I < \\'n-a,x - Tr/3,x\\ < C\\a - /?||. 

Using Assumption A2, 

II < / '^\Fs{x,a,z) - Fs{x,l3,z)\TT/3^^{dz) 



< C\\a 



So finally, we have checked that: 

||«^a;,Q! — Jx,l3\\ < C||a 



We then use Proposition 2.3 in Graham [18] to establish the solution to the 
martingale problem ()16p is unique. 

3.1.4 Step 4 : Weak convergence and Evolution equation 

In the three first steps we have proved that C{pL^) converges weakly to 
fj, = 5q, where Q is the unique solution of the martingale problem ()16p 
starting at Qq. 



23 



We can now identify the evolution equation satisfied by Q. Since Q satis- 
fies the martingale problem then (<3(t))t>o solves the non-linear Kolmogorov 
equation derived by taking the expectations in (fT6]) : 

(/, Q{T)) - if, Qm = riGfi; Q{t)), Q{t))dt. (18) 

JO 

Applying p8]) to / = lx„ for all n, we get the set of differential equations 
([6]). It immediately follows that F is also deterministic and T{dt,x,z) = 
dt ■ Q^{t) ■ T^Q{t)^x{z) almost surely. 

3.1.5 Proof of Lemma [3^^ 

First, M^'^ (t) is a square-integrable martingale by the Dynkin formula. Re- 
call that is defined in Equation ([5]) and that Af {k) = Ug^gA^''^ {k). 
In the sequel, EjFj.[.] will denote E[.|.Ffc]. With this notation, Ejr^, [l^jv^^.^] = 
and we can rewrite Equation (jl2p as: 

[7Vt]-l 
A:=0 s&S 

To prove Lemma l3.ll we first need to compute E[M/'^(t)M2'^(t)]. Since 
(M/'^(t))fg]g+ is a martingale this product is equal to: 

E[M/'^(OM/'^(t)] 

fc=0 s,s'e5 

xr'fe^(^)) ( - E^,x{<'^'(fc)} ) . 
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Now, let 



tN 



EE 

s,s'£S 



EE 

s,s'es 



X ( E^Jx{<'^(fc)}x{<'''(A:)}]-E^Jx{<'^W}]E^Jx{<'^'W}] 



Notice that 



E r('?f(|))r'fe^(|))E^Jx{<^(A;)h{<'^'(fc)}] 
4|i/liLE^,Erf''(^)}^i<'''(^)}] 

s,s' 

<A\\f\\lP{A^{k)A^{k)\Tk). 



s,s'£S 
< 



Analogously, we also have: 



E r(9f(^))r'fe"^(^))E^Jx{^f'^(fc)}]E^,[x{<''^'(A:)}] 

s,s'g5 



|2 13/ ,iAf/;,M -r No/ /lA^/ 



Therefore from ©, |/f | < 8\\f\\i,max{pN/N,l/N^) and 



|E[M/'^(t)M/'^ 



<8||/||Ltmax(/5;v,l/iV). 
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Similarly, we obtain 




-, [Nt]-1 / 



fc=0 \se5 
[Nt]-1 



k=0 



< mwit, 



and the lemma follows. 



□ 



3.2 Proof of Theorem [273] 

Assume that {{qf {0))i, Z^) represents the system of particles in station- 
ary regime. Then by symmetry, {qf is exchangeable. Define 11^ = 
jC(/i^,r^). We cannot apply directly Theorem 12.11 since we do not know 
whether a converging subsequence of ^^(0) converges weakly toward a de- 
terministic limit. 

We now circumvent this difficulty. By Assumption A9, as in Step 1 in the 
proof of Theorem l2.1l we deduce from Sznitman [27J Proposition 2.2, that 
is tight in V{D{W^,X)) and is tight in V{D{W+,X)) x lra{Z x X). Let 
Q in V{D{M+,X)) be in the support of n°° = (^°°,r°°), an accumulation 
point of n^. We can prove similarly that Lemma 13.31 still holds for Q. 

By Step 3 of Theorem 12.11 the solution of the martingale problem is 
unique and Q solves it with initial condition (5(0). The stationarity implies 
that fJ.^{t) and /i^(0) are equal. Note also that outside a countable set 
D, the mapping X i— > X{t) is continuous. So if t ^ D, Q{t) = fJ-°°{t) = 
/i°°(0) = (5(0). However, by Assumption A9, limt^+oo (5(*) = Qst- There- 



fore ^°°(0) = 6q^, and Q(0) = Qst- 

Theorem 12.31 is then a consequence of Theorem 12.11 
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4 A uniform domination criterion 



In this section we discuss the Assumptions A0-A9 made on the particle 
system. Assumptions A0-A6 are natural and can be checked directly. The 
additional assumptions A9 and AlO needed to derive the mean field limit in 

the stationary regime may be difficult to check: A9 is a tightness assumption 
on the stationary measures and AlO is the global stability of a differential 
equation. 

In this section we present a new set of assumptions, based on uniform 

domination of the transition kernel of the background process, that is prov- 
ably sufficient to ensure that Assumptions A7. The new assumptions are 
defined as follows: 

All There exists a transition kernel K on 2 which dominates the kernels 
^a,x- Specifically, let ^ be a partial order on Z such that /C^ = {u; G 
Z : w ^ z} is finite for all z E Z. There exists K such that for all N, 

K^,,{z,-) ^stK{z,-), 
where :<st is the stochastic order relation: P :<st P' if for all zi G Z: 

A12 The Markov chain Z(t) with transition kernel K is positive recurrent. 

Lemma 4.1 Under Assumptions A8 and A11-A12, A7 holds. 

Proof. Because the chain Z is positive recurrent, the long run proportion of 
time the chain Z spends outside a compact set /C^ is of probability at most 
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e/2 for some z G 2, so 



[Nt] N 

^i?r^([o,t]x^x/c.) = i-^(l^i5;x{zf(fc)G/c.}) 

A;=0 i=l 

. m 

k=0 

as ^ C50 Hence liminfTv £;r^([0, t] x X x JC^) > {1 - e/2)t. 

By A8 we know is relatively compact and hence tight. By (2.5) 
in [27] the tightness of /i^ is equivalent to the tightness of their intensity 
measures I{fi^) in V{D{R+,X)) defined by = En^{F) for F e 

B{{D(M.^ , X)), the Borel c-algebra associated to the Skorohod topology. 
Hence for every e > there exists a compact set K^: in D(K'^ , X) such that 
ini^ Efi^ (K^) > 1 — e/2. However by Remark 6.4 on page 124 in [15], for 
each T > there exists a compact set ICx ^ A' such that for all t G [0, T], 
{2;(t) : x(-) G K,} C /C^.. Hence, //^(t)(/C^.) > /i^(Ke) for ah t G [0, T] 
and for ah N. Consequently inf n Efj,'^ {t){JCx) > 1 - e/2 for ah t G [0,r]. 
However, for each t, 

lEr^{[0,t],)Cx,Z) = I f Efi''{u){}C.x)du>l-e/2. 
t t Jo 

by the above. We conclude A7 holds with /C = JCx x ICz- 

□ 

5 Application to random multi-access protocols 

We now apply the previous analytical results to study the performance of 
communication networks where users share a common resource in a dis- 
tributed manner. We consider for example Local Area Networks (LANs) 
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which are computer networks with relatively small geographic coverage (an 
office, a house, a part of a campus), and which constitutes the first crucial 
component of the Internet. Transmissions in LANs are handled either on a 
cable (wired LANs) or on a radio channel (wireless LANs, also commonly 
called WiFi). Here we will focus on wireless LANs (our analysis can be car- 
ried out similarly in the case of wired LANs). In wireless LANs, users that 
are close to each other or that wish to transmit to the same receivers interfere 
in the sense that they cannot simultanerously transmit packets succesfully. 
Two interfering users transmitting simultaneously are said to experience a 
collision. A collision is detected by a user at the end of the packet trans- 
mission when the corresponding receiver does not acknowledge a successful 
reception. One of the most challenging problem in computer networking 
has been to design mechanisms so that interfering users could efficiently and 
fairly share the resource in a distributed manner. Currently, users willing 
to transmit packets through a wireless LAN, implement two standardized 
mechanisms. Carrier Sense Multiple Access (CSMA) and a random back-off 
algorithm referred to as the Decentralized Coordination Function (DCF), 
see [2]. In this section we aim at analyzing the performance of a general 
class of mechanisms, including the current CSMA - DCF couple, and at un- 
derstanding whether current mechanisms perform well or if they still require 
important improvements. 

In the next subsection, we provide a short description of CSMA and of 
a class of random back-off algorithms, but also introduce a simple model for 
interference, and explain why the performance in wireless LANs is difficult 
to study. In the subsequent subsections, we explain how the results derived 
earlier in the paper for particle systems allow us to circumvent this difficulty 
and explicitly characterize the performance in these networks. 
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5.1 Distributed mechanisms and performance in wireless LANs 

5.1.1 Carrier Sensing mechanisms 

A first mechanism to separate transmissions of interfering users in time is 
CSMA. Before transmission, each user senses the channel, and should it be 
busy, it abstains from transmitting. This sensing mechanism may be too 
simple to capture the actual interference structure of the network (since for 
example, the sensing is made at the transmitters, whereas interference is 
experienced at the receivers). Collisions may occur due to hidden terminals, 
and a loss of efficiency can be due to exposed terminals, see e.g. \19j. Hidden 
terminals refer to users whose transmissions interfer at the receiver, but are 
not able to detect (sense) each other. On the contrary, exposed terminals 
are users that do not interfere at the receiver, but cannot simultaneously 
transmit because they sense each other's transmissions. In this paper, for 
simplicity, we restrict our attention to a perfect Carrier sensing mechanism, 
where users sensing each other actually interfere at the receiver (we believe 
the analysis could be extended with hidden and exposed terminals). 

5.1.2 Random back- off algorithms 

Even under a perfect carrier sensing mechanism, collisions cannot be com- 
pletely avoided if two users start transmitting simultaneously. To further 
reduce collisions, each user runs (independently of other users) a random 
back-off algorithm. After each successful transmission or each collision, the 
user randomly picks a value for its back-off counter according to some dis- 
tribution on N. This value represents the number of slots the channel has to 
be observed idle before that the user may start transmitting (basically the 
user decrements its counter by one after sensing the channel idle during one 
slot). Note that slots have a fixed duration that does not depend on the user 
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(between 9 and 20 microseconds in IEEE802.il standards [2]). The details 
of this mechanism works is exemplified in Figure [5.1.2[ 



L 



DIPS 




SIFSj 


DIPS 


n 


j TRANSMISSION 







Figure 2: User behavior - the case of a successful transmission. Before 
t = 0, the channel is sensed busy. At time DIES, (DCF Inter Frame Space), 
the user starts decrementing its back-off counter again by one per slot, and 
transmits when the latter reaches 0. After transmission, the receiver waits 
for a duration of length SIFS (Short Inter Frame Space) and then sends 
the packet acknowledgment. After receiving this acknowledgment, the user 
picks a new back-off counter (12 in this case) and waits DIES before starting 
decrementing it. Note that the inter-frame spaces are introduced to handle 
the acknowledgment procedure, and that DIES > SIFS. 

A random back-off algorithm specifies how the distribution (or just its 
mean) of the back-off counter is modified after either a successful transmis- 
sion or a collision. Currently the DCF is a version of the classical binary 
exponential back-off algorithm: after each successful transmission, a user 
picks a back-off counter uniformly in {0, . . . , CVFmin}, and after m succes- 
sive collisions uniformly in {0, ... , 2™CVFmin}L.- 

In the following, we assume that the back-off distribution is always geo- 
metric (so as to keep a simple Markovian setting), although we could easily 
generalize the analysis to uniform distributions. With this assumption, each 
user transmits with a given probability p at the beginning of each idle slot. 
We consider the following generic way of adapting this probability: first the 
probability belongs to a countable set B, after a successful transmission p 
is updated to S{p), and after a collision p is updated to C{p), where S{-) 
(resp. C(-)) is a decreasing (resp. increasing) mapping from B B. We 
denote by po = max{p € B}. Finally, we denote by L (in slots) the average 

duration of a successful packet transmission (including its acknowledgment, 

^Note that in the DCF, m is upper bounded by 7. 
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see Figure I5.1.2p , and assume that collisions have average durations equal to 
Lc that might be different than L. Again to keep the formalism simple, we 
assume that the durations of successful transmissions and collisions are geo- 
metrically distributed (a multiple of slots), which again does not constitute 
a crucial assumption. 

5.1.3 Interference model and user class 

We consider a simple model for interference as follows. First, the N users 
are classified according to their interference properties, i.e., two users belong 
to the same class if they interfere with (resp. are interfered with and by) 
the same set of users. Two users are of the same class if the corresponding 
links are located in the same geographic region (see for example the network 
of Figured]). Denote by C the set of user classes, and by fic the proportion 
of users of class c. i (z c denotes the fact that user i is of class c. Then 
interference between users of different classes is characterized by the inci- 
dence matrix A such that A^d = 1 if class-c users interfere class-d users, and 
Acd = otherwise. Note that A is not necessarily symmetric (in the network 
of Figure dl it is symmetric). We denote hy Vc = {d £ C : Acd = 1} the set 
of classes of links interfering with class-c links. 

We say that the network has full interference if Acd = 1 for all c, d and 
has partial interference otherwise. 

5.1.4 Performance metrics 

The performance metrics we aim at analyzing is the long-term throughput 
(the number of packets successfully transmitted per time unit) achieved by 
the users of various classes. We denote by 7c the throughput of class-c users. 

Deriving expressions for this performance metrics is notoriously difficult. 
This is due to the inherent interactions between users through interference. 
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A popular approach to circumvent this difficulty consists in decoupling the 
users, i.e., assuming that the (re)-transmission processes of the various users 
are mutually independent. This heuristic has been used by Bianchi [7J to 
capture the performance of wireless LANs with full interference. In this 
work, we formally justify this approach, and extend it to networks with par- 
tial interference. To do so, we apply the mean field analysis derived in the 
first part of the paper. In case of full interference, the network can be mod- 
eled as a simple system of particles with no randomly varying environment 
(as already noticed in a preliminary work [9j). However, to analyze a net- 
work with partial interference, the introduction of this varying environment 
is necessary. As it turns out, the spatial heterogeneity in networks with 
partial interference may lead to important fairness issues, as mentioned in 
introduction, and our analysis explicitly quantifies these issues. 

5.2 Model analysis 

We consider a network of N users as described in the previous subsection. 
We analyze the system at the beginning of each slot. Denote by pf {k)/N 
the probability user i becomes active at the end of the k-ih. slot, if idle (note 
that we already renormalized this probability by to be able to conduct 
the asymptotic analysis when N grows large). For all i, k, N , pf{k) € B. 

To capture the network dynamics, we define a process = {Z^(A;), k > 
0} representing the state of classes during slot k. Z^{k) € {0,1,2}, where 
Zc{k) = if and only if there is no transmitting user of class c, Z^{k) = 1 if 
and only if there is one successfully transmitting user of class c and Z^{k) = 
2 if and only if there is at least one user of class c currently in collision with 
another user in Vc- Let Z = {0, 1,2}I'-'I denote the state space of Z. We 
introduce the clear-to- send functions Cc as follows. If Z^{k) = z, a class-c 
link is clear to send at the end of slot k and Cdz) = 1 if = for d € Vc, 
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otherwise Cc{z) = 0. 

We show how to model the network as a set of interacting particles as 
described in Section [2l 

• The particles: the i-th user corresponds to the i-th. particle with state 
describing the class of the user and the transmission probability at the 
end of the next idle slot (A:) = {ci,p^{k)) eX = CxB. 

• The environment process: the process introduced above is a sim- 
plified version of an environment process as described in Section [2j 
The evolution of the environment is determined by the states of all the 
particules through . The evolution of the i-th particle depends on 
whether or not the corresponding user senses the channel idle or not, 
i.e. Z^{k) = Z^{k) for i G c. 

Particle transitions We first compute the transition probabilities for the 
various particles. The set S of possible transitions is composed by two 
functions, the first one representing a successful transmission p ^ S{p) and 
the other one collisions p ^ C{p). Note that the class of a particle / user does 
not change. Let {k) = ^ Eili "^pf {fc)lc(i)=c and {k) = {iy^{k))cec- 
Assume that at some slot k, the system is in state 

((cf (fc),pf (A;)),=i„„A.,z.^(A;),Z^(A;))) = ((c„k),=i,...,a., a, z). 

A class-c user i may have a transition at the end of slot k only if Cc{z) = 1. 
In this case it can either initiate a successful transmission or experience a 
collision. If Cc{z) = 1, the event that none of the users in c transmits at 
the end of slot k is given by = Higc '^{NUi>pi)j where the C/j's are i.i.d. 
r.v. uniformly distributed on [0, 1]. The event that user i G c accesses the 
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channel with success at the end of slot k is given by the indicator: 
x{NU,<p,}C,iz) H x{NU,>p,} H (^Cdiz)D^ + {l-Cdiz))y 

Averaging the above quantity gives the transition probability {{c,pi), a, z)/N 
corresponding to a successful transmission. For all a G V{B) and all / B- 
valued functions, define (/, a) = J2p fip)'^ip)- Moreover let Qc denote the 
restriction of a to users of class c. Let / denote the identity function. One 
can readily see that we have: 

F,^((c,p.),a,z) = ^-|— n (c,(.)(e<^i°s(^-^)'-)-l) + l) . 

(19) 

Similarly, the event that user z G c experiences a collision at the end of 
slot k is given by the indicator: 

x{NU,<p,}C,iz)ll- n x{NU,>p,} n [Cd{z)D^ + {l-Ca{z))) 

and the transition probability Fq {{c,pi),a, z) /N corresponding to a collision 
reads: 

\ P''^^ dev. 

(20) 

In order to fit into the scheme to the particle system of Section [21 we 
need to introduce a virtual transition from {c,p) to {c,p) with transition 
rate F^ {{c,pi), a, z) = 1 — piCc{z). With this virtual transition the sum of 
the transition rates sums to 1. Note that Assumption is satisfied. Since 
A^log(l — x/N) converges to — x, we obtain the following expressions for the 
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asymptotic transition rates, Fii){{c,pi),a,z) = 1 —piCc{z), 

Fs{{c,pi),a,z)=piCciz) n (Cd(z)(e-<^'-<^)-l) + l), (21) 

deVc 

Fci{c,pi),a,z) =PiCc{z) I 1 - n ( Cd(^)(e-<''"''> - 1) + 1 ) ) . (22) 

The convergence of Fg (rcsp. Fq) to Fs (resp. Fc)is uniform in a and z, 
so that Assumption Al is satisfied.lt is also easy to check that the functions 
Fs and Fc are uniformly Lipschitz, which ensures Assumption A2. 

Transitions of the background process Assume that the system 

is in state {{ci,Pi)i=i^,,,N,ct, z). The transition kernel for is given 

by: for all z, z' G Z, 



K^{z,z') = K^^,(z,/)<A.(^,^')i^i::D,(^,^'XD.(^,^'Xo(^,^')- 

(23) 

^aAi^ respectively K^j^,_^, corresponds to the transitions of links starting 
successful transmissions, respectively collisions: 



Ka,m = n c.wEf n (i-f)). 

{c}GAi(2,2') tec jy^ijec 

{c}eAi(z,z') i£c 

= n C'c(^)(Y3^,ac)e<^'°^(i-^)'->), 

{c}eAi{z,z') ' 



EeA2(2,2') 
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where, if = {c}, 



= c„(.)(i-n(i-|)-E| n 

= C,{z) (l - (1 + (3^:^,ac))e<^i°^(^-^)'"^> 



and if \E\ > 2, 



^°(^) = n n^^(^)(i-n(i-|)) 

EeA2{z,z') ceE 

^aDi ' respectively , corresponds to the transitions of hnks with suc- 

cessful transmissions, respectively with collisions, which become inactive: 



\D2{z,z')\ 



Finally, K^fi corresponds to classes that are not changing their state between 
z and z': 

/ 1 N \Ni{z)\D^{z,z')\ / , X \N2(z)\D2(z,z')\ 

. (i-i) (i-i-) 

c:Zc=0=z'^ \ iec / 

f 1 \ / 1 \ l^2(2)\D2(2,2')l 

X n (<^c(^)e<^'°^^^"^^'"=^ + l-Cc(^)). 

C:2c=0=2^ 

The limit kernel of is obtained replacing {N log(l— ;^), Og) by — (/, 
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in the above expressions. The Assumptions A3-A6 can then be easily veri- 
fied. 



Mean field asymptotics We now verify that Assumptions A11-A12 are 
satisfied, implying that Assumption A7 also holds. Let us build a transition 
kernel K, corresponding to a process Z with values in Z = {0, 1, 2}l'-'l . When 
equal to 0, a component of Z almost surely becomes 1 at the next slot, and 
whatever the state of the system is. The kernel K then corresponds to a 
system where there are always users of each class attempting to use the 
channel at each slot. One can easily verify that Assumption A11-A12 are 
satisfied for this kernel K, for the partial order ^ on Z defined hy z ^ z' if 
and only if there is no class c such that = 1 or 2 and z'^ = 0. 

We rescale time and define qf^{t) = pf^{[Nt]). Since the set of transitions 
is finite, the tightness of C{qi {■)) follows easily from Theorem 7.2 in Ethier- 
Kurtz [15j p 128. (see the comment after A8). It follows that Theorem 
12.11 applies. Assume that the class of the particle i is a r.v. fixed at the 
time such that the vector (ci, • • • , c^r) is an exchangeable random vector 
(for example the Cj's may be i.i.d. and equal to c with probability fic)- 
Theorem 12.11 asserts that as — > oo, the qf^s become independent and 
evolve according to a measure Q = {Q{t))teR+ ■ 

5.3 Stationary throughputs 

Assume that Assumptions A9-A10 hold, so that Theorem 12. 31 applies. These 
assumptions will be partly justified below for the case of the binary ex- 
ponential back-off algorithm. We are interested in deriving the stationary 
throughputs achieved by users of various classes. To do so, we derive the 
stationary distribution Qgi and ttq^^ of the particles and the background pro- 
cess. To simplify the notation we write Qst = Q and ttq = vr. Also denote 
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Qc = Q{{c,p}) the stationary proportion of users of class c transmitting 
with probability p. 

Consider the point process of returns to the set A = {z : Cc{z) = 1}. Let 
Ti denote the first return time after time zero. By the cycle formula (see 
(1.3.2) in [jSj) we may express the steady state probability of a user in c suc- 
cessfully transmitting a packet by the mean time spent in the transmission 
state per cycle divided by the mean cycle length. The expectation is calcu- 
lated with respect to the Palm measure of the point process of returns to A 
but in this Markovian case this just means starting on A with probability 
TT"^ which is vr renormalized to be a probability on A. 

A user in c can only go into a successful transmission state once per cycle; 
i.e. no other user in c transmits and other users in Vc are either blocked or 
remain silent. Hence the mean time per cycle spent in a transmission state 
is Y^zeA'^'^(^)^9iz) where 

9iz)=Pc n iCd{z){e-^--l) + l). 

Moreover, ^^eA'^'^^^'^-^^^-'^^'^ ~ ^F(l4)' intensity of the point process 

of visits to A. Finally the total throughput of the users of class c is 

7e = Yl <^)^P'^ n {Cd{z){e-P'^ - 1) + 1) , (24) 

z:Cc{z) = l deVc 

where 

Pc = YpQ''c, (25) 
peB 

which can be interpreted as the probability that a user of class c attempts 
to use the channel at the end of an empty slot. We now evaluate Q and vr. 
Note that vr depends on Q through the pcS only (see and its limiting 
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expression). Then we can write: 

7r(z) = ^{z, pc, c G C); i.e. tt is a function of pc, c G C, (26) 
Now define Gc, He and Ic as follows: 

Gc = J27T{z)Cc{z)ll (^C,{z){e-P^-l) + l), (27) 

z d£Vc 

He = J2<')Cc{z)ll-ll [c,{z){e-'^^-l) + l)], (28) 
z \ deVc / 

Ic = Gc + Hc = ^tt{z)Cc{z). (29) 

z 

Gc,Hc,Ic depend on Q through the pcS only. We have for all c,p: pGc = 
Fs{{c,p),Q), pHc = Fc{ip,c),Q). The marginals Qc satisfy the balance 
equations i.e., for all c,p, 



Gc I Yl P'Qc -pQn+Hci Yl P'Qc - PQ? 1 = 0. (30) 

^p'eB:S(p')=p J \p'€B:C{p')=p 

They also satisfy: 

VcgC, Yqp = Pc- (31) 

peB 

Summarizing the above analysis, we have: 

Theorem 5.1 The stationary distribution Q is characterized by the set of 
equations (2^, (2^, m), (ETP- 



5.4 The binary exponential back-off algorithm 

We now examine the specific case of the binary exponential back-off algo- 
rithm. We first justify Assumption A9. 
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5.4.1 Tightness of stationary distributions 

Lemma 5.2 In case of the exponential hack-off algorithm, there exists a 
p* > 0, such that for any < pq < p* , the Markov process {Xf {k), {k))^^^ 
is positive recurrent for all N and the family of stationary distributions 
Cst{X^{<^)) is tight. 

Deriving a tight bound for p* would involve technical details which are 
beyond the scope of this paper. We will only sketch the main idea and prove 
p* > 0. Also to clarify the presentation, we assume here that L = Lc- Along 
the proof of Lemma 15.21 we may check that the statement of Lemma 15.21 
holds for p* = where JI = maxcgc 7^c ^^'^ V-c — Z^deVc mean 
proportion of particles which are in interaction with particles of class c. 
Proof. To prove the recurrence we introduce a fictive system which stochas- 
tically bounds Pi{k). 

In the fictive system, the states of the particles i > 2 are independent, a 
particle i > 2 has two states: active or inactive. If the particle i > 2, is active, 
it remains active for the next slot with probability 1 — if it is inactive, 
it becomes active with probability Pq/N . The stationary probability that 
the particle i is active is L/{L + N/po) and the stationary probability that 
at least one is active isaAr = l — (1 — L/(L + N/po))^^^ which converges to 
a = 1 - e-^Po. 

The particle 1 tries to become active at slot k with probability p^ {k)/N . 
If it remains inactive, Pi{k) = p^ {k+l). If it is active and if another particle 
is also active, then the particle 1 encounters a collision and p^ {k + 1) = 
Pi {k)/2. Otherwise Pi{k + 1) = pQ. 

Clearly, this virtual system is stochastically less than or equal to Pi{k) 
in the exponential back-off case. 
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Let b^{k) = Po/Piik), b^{k) G {2"}„eN, the lemma will follow if we 
prove that for pQ small enough, 



sup E[6'" (A;) I b'^ (0) = 1] < oo. (32) 

N,k 



In the remaining part of the proof, using elements of queueing theory, we 
justify (I32D . 

We first analyze the sequence of slots such that none of the particles 
z > 2 is active. If the particle i > 2 is active at time k, let li{k) be the 
number of slots the particle remains active. li{k) is a geometric distribution 
with parameter 1/L. Now, let 



W^(k) = max v|z active|L(A;). 

2<i<Af 



If W'^ (k) = none of the particles i > 2 is active at time k. satisfies 
the recursion: 

W'^ (k+l) = max ^ {k) — l, max^xji active at A; + 1, inactive at k}li{k+l) 



is thus the workload in a G/G/oo queue with inter-arrival time 1 and ser- 
vice time requirement a^{k-'rl) = maxj>2 active at A; -|- 1, inactive at A;}/j(A;-|- 
1). Independently of the past, {k + 1) is easily bounded stochastically; 
indeed, let < s < InL, 

N 

ggs<x^(fc+i) < l + Y^ Ex{i active at A; + 1, inactive at A;}e"'»(''+^) 

1=2 

< l + (N- l)E^'^e'^^ik+l) 
e-'/L 



1 - (1/L)e^ 
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Note that this last bound is uniform in and k. Let = 0, ^n+i = inf {A; > 
9n ■ W^{k) = 0}, and 9^ = {9n}neN- Classically, there exists C > such 
that for ah N: 

E[e^(^"+i-^") |PF^(0) = 0] < oo, 

see for example Appendix A. 4 in [4j. By the renewal theorem, we deduce, 
uniformly in A^, limfc^ooP(^ ^ G^) = = 1 — a^. Moreover, the mono- 
tonicity of W'^ (k) with respect to the initial condition implies easily that 
F{k G @^\W^{0) = 0) > limfc^ooP(A: G 9^) = 1 - un- Since 1 - un 
converges to e-^P°, it follows that 

lim inf P(A; G Q^\W^{0) = 0) = 1. (33) 

po— »0 k,N 

We now turn back to the process and prove ()32p . Let U (k) be a sequence 
of independent and uniformly distributed variables on [0, 1]. We may write 

In particular 

b^{k + l)x{bN(k)>2} < b^{k)x{uik+i)>^^} + 2b^{k)X{u{k+i)<^^}X{kte^} 

+X{u{k+i)<^}X{kee'^} 

Taking expectation, we obtain 

E6^(A: + 1)X{,-(,)>2| < Eb^{k)-^ + 2^F{k^e^) + ^F{kee^) 

< Eb^ik) - ^ (hik G 9^) - l) . 
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Similarly, since b {k + l)X{b''^ {k)=i} ^ 2, we have: 

Eb^ik + 1) < max ^2, Eb^ (k) - ^ (^^P(fe e G^) - 1 

From ([33]), for po small enough, for all iV and A; > 0, P(A; G 6^) > 2/3. We 
deduce by recursion that E[b^ {k)\b^ (0) = 1] < 2 and holds. □ 

5.4.2 Stationary distribution 

Now Lemma 15.21 implies that Assumption A9 holds. It remains to check 
Assumption AlO. In the next paragraph, we state that Assumption AlO 
holds if there is a unique class of users, i.e., in the case of full interference. For 
the general case of partial interference, we can only provide a characterization 
of the equilibrium point of the dynamical system ([6]) . We leave the study of 
its global stability for future work. 

So let us assume that an equilibrium point exists, and denote by Q this 
point. Further define = Qdc, po2~"}) for all n € N. Then we have: 

Qc" '^c((po2-"+\ c), Q) = Q^(F5((po2-", c), Q) + Fc((^5o2-^ c), Q)), 

or equivalently 

2Q^-'H, = Q,"I„ (34) 

and 

E Qc^5((po2-", c), Q) = Q°Fc((po, c), Q)), 

n>0 

or equivalently 

PcG, = QlH,. (35) 

Solving dMD and ([35]) leads to a solution of the form Q^? = /3c(2i7c//c)"- 
Since En Qc = A'c, we have /3e = Q° = ^ic{l - 2HjQf,,{Gc - H,)/I,. We 
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require that He < Gc or equivalently, Gc/Ic > 1/2. Gc/Ic may be interpreted 
as the probabihty in steady state that no user of class in Vc tries to access 
the channel given that no user of class in Vc are currently sending. Next, 
Pc = Sn>oPo2~"(5c 1 which implies that: 



Gq Hq , , 

Pc=Pof^c — ^ • (36) 



Now the following corollary summarizes the above analysis and then it char- 
acterizes the system behavior in steady state and in case of exponential 
back-off algorithms. 

Corollary 5.3 The stationary distribution Q is given by: for all c G C, 



Q: = i^c 



Gc — He ( 2H, 



Gc + Hc\Gc + He 



where the G'^s, Hg 's, and pc 's are the unique solutions of the system of 
equations (2^, 



5.4.3 Global stability in the mean field regime for networks with 
full interference 

In this paragraph, we consider the exponential backoff algorithm and we 
assume moreover that there is a unique class of users. In that case, the 
analysis in greatly simplified: the environment variable Z'^ and the clear- 
to-send function C are then identical for all users. The backoffs of the users 
evolves only if = 0. Thus, up to sampling by the times such that 
Z^ {t) = 0, in order to analyze the backoff process, we may assume without 
loss of generality that L = Lc = 1. 

Let Q^{t) be the mean field limit of the proportion of users with backoff 
Po/2". From Theorem 1 2. 11 given an initial distribution {Q"(0); n = 0, 1, . . .}, 
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the limit evolves as, for all n > 1, 



^(t) = 2i->oQ"-Hi)(l-exp(-5;2-VoQXi))) -2->oQ"(i), (37) 

1=0 



= ^ 2->oQ"(t) exp(- J2 - PoQ'it). (38) 

n=0 i=0 

Following §5. 31 and Corollary [531 the dynamic system described by differ- 
ential equations ([37|) - ([38]) admits a unique equilibrium point Qst = {Qsu ^ — 
0, 1, . . .} defined by: 

Vn>0, Q:, = (2(l-e-^-))"Q0„ = p,,e-''-/po 

where pst solves poe^ + p — 2po = or po = p/{2 — e^). Note that pst < ln(2) 
so necessarily 2(1 — e"''"*) < 1, and the stationary distribution always exists. 
Moreover p,t = EZo'^'^PoQlt- 

Now let p{t) = Ei~o2~>o<5*(i) so (l37])-(l38l) can be written as 

= 2i-"poQ""^(t)(l - e"^(*)) - 2->oQ"(t), for all n > 1, (39) 

= Pit) exp(-p(t)) - poQ'it). (40) 

In complete interaction, Assumption A9 holds. Indeed, we have the 
following: 

Theorem 5.4 If po < ln(2), for any initial condition Q{0), Q{t) converges 
(weakly) to the measure Qst- 

Lemma 5.5 If Po < ln(2), the sequence of measures Q{t) = {Q"(t);n = 
0, 1, . . .} is tight. 
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Proof of Lemma \5. 51 We define the linear system, 



(t) = 2i->oS"-i(t)(l-exp(-po))-2->oi?"(i), for all n > 1, (41) 



dt 

^(t) = ^ 2->oi?"(t) exp(-po) - PoB'^it) (42) 

n=0 

with initial condition i?"(0) = (5"(0) for all n. First note that the time 
derivative of ^,„i?"(i) is zero, hence Y^'^=QB^{t) = 1 for all t > 0. Note 
also that p{t) < pQ. B"'{t) corresponds to mean field limit of the proportion 
of users with backoff po2~" when each user is in interaction with N other 
users with backoff pq. We may then check that the probability measure 
B{t) = {B^[t);n > 0} is stochastically larger than Q{t): for all m > 1, 
J2n>m B^(^) — Sn>mQ"(^)- However B(t) converges to the unique invari- 
ant probability measure of the linear system: i?"^ = (2(1 — exp(— po))"-^^^ 
(recall that po < ln(2)). Since B{t) converges, it is therefore tight. It follows 
that Q{t) is tight. □ 
Proof of Theorem \5.4\ Let liminft_^oo p(i) = Pb- Pick a subsequence tfc 
such that limtj._+oo /3(ifc) = Pb and such that the limit limtf^^ooQ^iik) = 
Q^{oo) exists for all n. By Lemma [531 Q{oo) = {Q^{oo);n = 0, 1, . . .} is a 
probability measure and ^"^Q^'^poQ'^ioo)) = pb. 

Let fb{t) = miu>tp{u)- Note that fb{t) increases to pb and fb{t) < p{t) 
for all t > 0. Now consider the system 

= 2i->o(3""'(t)(l - e-f^^'^) - 2->oQ"(i), for all n > 1, 

= fb{t)expi-fb{t))-poQ'it) 
with initial condition Q"(0) = <3"(0) for all n G N. Now notice that the 
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function pexp{—p) is strictly increasing for < /3 < 1. Hence, for t >0, 

Q\t) = e-P''Q\0)+e'P'' f eP''Ms)exp{-Ms))ds (43) 

Jo 

< e-fo*Q°(0) +e-fo* / eP'>'p{s)exp{-p{s))ds 
Jo 

= Q°(i)- 
Therefore for all t > 0, 

< Q\t) < Q°(t). 
We then prove by recursion on n that 

VnGN, Vt>0, < < (44) 

Let n > 1, and assume that for all t > 0, (5""^(t) < Q"(t). We have: 

Q"(t) = e-P°2-"*g«(o) + e-P«2-"* T eP°2-"^po2i-"Q"-i(s)(l - e--^''(^Vs 

JO 

= Q"(i). 

From (gSD we also conclude that Q"(i) < Q''(t) for ah t so (gi]) follows. 
Next, using L'Hopital's rule in (I43p we get 

Q°(oo) := lim Q^{t) 

t— >oo 

eP»Vfc(t)exp(-A(t)) pbe-^^ 
= lim 7 = • 
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Moreover, by iteration 



Q"(oo) := lim g"(t) 



lim 

2(1 - e-P') lim = (2(1 - e"'"'))"^^^. 



This expression of (5(oo) implies 

oo 

5^Po2-"Q"(oo) = p6 = J^po2-"Q"(oo) 



oo 



n=Q n=0 



However, (jM]) implies that for all n G N, Q"'{qo) < Q"-{oo), it follows that 
Q"'(oo) = (5"'(oo), and therefore. 



oo 



n=0 



But from the above expression for Q"'(oo), we have: 



oo 



l-2(l-e-PS 
Pb 



Poi2-ePb)' 

We conclude p;, solves po = p/{2 — e^). Hence ph = pst and this means 

Q"(oo) = g"(oo) = for ah n. 

Hence any subsequence of Q^{t) converges to and this gives our result. 
□ 
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5.5 A numerical example 

We now illustrate our analytical results on the simple network of Figure 
[TJ Each link runs an exponential back-off algorithm with po = 1/16 as 
specified in the 802.11 standard [2\. In Figure [3l the throughputs of the 
various user classes are presented assuming that the proportions of users of 
class 1 and 3 are identical, fii = fi^. We assume here that Lc = L. We 
give the throughputs as a function a the proportion of users of class 2. Here 
the packet duration is fixed and equal to L = 100 slots. The total network 
throughput decreases when the proportion of class-2 users increases, which 
illustrates the loss of efficiency due to the network spatial heterogeneity. 
In Figure HJ we assume a uniform user distribution among the 3 classes, 
/^i = = /X3, and we give the throughputs as a function of the packet 
duration L. First note that whatever the value of L, the network is highly 
unfair: for example when L = 100 slots, the throughput of a user of class 
1 is almost 5 times greater than that of a user of class 2. This unfairness 
increases with L and ultimately when L is very large, users of class 2 never 
access the channel successfully. We have verified through simulation that 
mean field asymptotics led to quite accurate performance approximations, 
even in the case of systems with a small number of users. This has been also 
observed in [7j for networks with full interference. 
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Figure 3: Throughputs of links as a function oi fj,2 - L = Lc = 100 slots. 




I ' ' ' ' 1 

100 200 300 400 500 

Packet transmission duration (In slots) 



Figure 4: Throughputs of links as a function of L, when //i = //2 = M3- 
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